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Abstract 

This is the second part of a two-part paper that studies the problem of jamming in a fixed-rate transmission system with 
- - , fading. In the first part, we studied the scenario with a fast fading channel, and found Nash equilibria of mixed strategies for 

short term power constraints, and for average power constraints with and without channel state information (CSI) feedback. We 

■ also solved the equally important maximin and minimax problems with pure strategies. Whenever we dealt with average power 
' constraints, we decomposed the problem into two levels of power control, which we solved individually. In this second part of 

the paper, we study the scenario with a parallel, slow fading channel, which usually models multi-carrier transmissions, such as 
^jQ- OFDM. Although the framework is similar as the one in Part I [1], dealing with the slow fading requires more intricate techniques. 

^ ■ Unlike in the fast fading scenario, where the frames supporting the transmission of the codewords were equivalent and completely 

<| characterized by the channel statistics, in our present scenario the frames are unique, and characterized by a specific set of channel 

realizations. This leads to more involved inter-frame power allocation strategies, and in some cases even to the need for a third 
\^ ■ level of power control. We also show that for parallel slow fading channels, the CSI feedback helps in the battle against jamming, 

■ as evidenced by the significant degradation to system performance when CSI is not sent back. We expect this degradation to 
decrease as the number of parallel channels M increases, until it becomes marginal for M ^ oo (which can be considered as 

I— I, the case in Part I). 
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I. Introduction 



The concept of jamming plays an extremely important role in ensuring the quality and security of wireless communications, 
especially at this moment when wireless networks are quickly becoming ubiquitous. Although the recent literature covers 
^ a wide variety of jamming problems [2], [3], [4], [5], [6], [7], [8], the investigation of optimal jamming and anti-jamming 
OO strategies for the parallel slow-fading channel is missing. 

The parallel slow-fading channel is a widely used model for OFDM transmission [9]. Since the usual definition of capacity 
does not provide a positive performance indicator for this model, a more adequate performance measure is the probability of 
outage [9], defined as the probability that the instantaneous mutual information characterizing the parallel channel, under a 
given channel realization, is below a fixed transmission rate R. Under the optimal diversity-multiplexing tradeoff, the parallel 
slow-fading channel with M subchannels is known [9] to yield an M-fold diversity gain over the scalar single antenna channel. 
However the diversity-multiplexing tradeoff only gives an approximative analytical evaluation of the probability of outage for 
a given rate R and a signal-to-noise ratio (SNR), and this approximation is usually accurate only in the high SNR region. 
. ^ , Thus, for evaluating a system which functions at a moderate SNR, the exact probability-of-outage vs. transmission-rate curve is 
■ often computed numerically. Moreover, the high SNR assumption is clearly not adequate for studying a practical uncorrected 
^ I jamming situation, where the jammer's power should be considered at least comparable to the legitimate transmitter's. 
- - ' Therefore, we aim at deriving the exact probability of outage achievable in the presence of a jammer, over our parallel 
slow fading channel, for a fixed transmission rate R. Our channel model is depicted in Figure [T] The span of a codeword is 
denoted by "frame". To model our parallel slow fading channel, each frame is divided into M "blocks" (corresponding to the 
M subchannels), each of which consists of N channel uses, like in Figure [2l 

The channel fading is slow, such that the corresponding channel coefficients remain constant over each block and vary 
independently across different blocks. The channel coefficients are complex numbers, and their squared absolute values are 
denoted as hm- The vector h = [/iq, ^i, • • • , ^m-i] of channel coefficients over a whole frame is assumed to be perfectly 
known to the receiver, and can be made available by feedback (if the receiver wishes) to the transmitter (Tx), and jammer 
(Jx) before the transmission begins. It was shown in [10] that the feedback of channel state information (CSI) (i.e. the M 
coefficients of a frame) brings moderate benefits for the parallel slow-fading channel without jamming. Thus, by employing 
optimal power control strategies, the transmitter can lower the probability of outage for fixed transmission rate and SNR. In this 
paper, we study both the scenarios when the CSI is fed back by the legitimate receiver - and hence all M channel coefficients 
characterizing a frame are available to both transmitter and jammer in a non-causal fashion (it is only natural to assume that if 
the transmitter has full CSI, the jammer can get the same information by eavesdropping) - and the scenario when no feedback 
takes place and thus the CSI is only available to the receiver. 
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^R. Kannan is with the Department of CS, Louisiana State University, E-mail: rkannan@bit.csc.lsu.edu. 
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In addition to fading, the transmission is affected by additive white complex Gaussian noise (AWGN), and by a jammer. 
The jammer has no knowledge about the transmitter's output, or even the codebook that the transmitter is using, and hence it 
deploys its most harmful strategy: it transmits white complex Gaussian noise [11] (AWGJ in Figure [T]). 

The transmitter (Tx) uses a complex Gaussian codebook. Over a given frame, it allocates power Pm to block m, < m < 
M — 1, while the jammer (Jx) invests power Jm in jamming the same block with noise. As assumed in [10], the number of 
channel uses per block is large ^ oo in order to average out the impact of the Gaussian noise. Under these assumptions, 
the instantaneous mutual information characterizing a subchannel m is given by I{hm^Pm^ Jm) = log(l + Vi^r )^ where 
CF% is the variance of the ambient AWGN. The following denotations will be repeatedly used in the sequel: 

• Power allocated by the transmitter over a frame: 
P — J_ v^^-i p . 

• Power allocated by the jammer over a frame: 

T —J- Y^^-i 7 . 

• Instantaneous mutual information between the transmitter and the receiver over a frame: 

Note that Pm is a function of the channel realization h, so we often write PM(h) when this relation needs to be explicitly 
emphasized. PM(h) can also be interpreted as the function giving the power distribution across different frames. We also use 
Pjwih) and Jjvrih) to denote inter-frame power allocation for the case M = 1, since in this case a frame only contains one 
block. Like in [1], throughout this paper we shall also use the notation c = ex.p{MR) for simplicity. 

As depicted in Figure [T] our channel model is similar to that of [2] . The difference, however, is that we investigate the 
jamming problem in slow-fading channels and hence the probability of outage, defined as the probability that the instantaneous 
mutual information Im of the channel is lower than the fixed transmission rate R [10] is considered as an objective function 
Pout = Pt{Im < R) (while [2] assumes fast fading and uses the ergodic capacity as objective). Our problem is still 
formulated as a two-player, zero- sum game. The transmitter wants to achieve reliable communication and hence minimize the 
outage probability, while the jammer wants to induce outage and maximize the outage probability. Strategies consist of varying 
transmission powers based on the CSI (i.e. the perfect knowledge of h) if available, or solely on the channel's statistics if CSI 
is not available. The properties of our different objective function make our new jamming and anti-jamming problem much 
more challenging to solve. 

It is easy to find similarities to the fixed rate system with fast fading which was studied in the first part of this paper [1]. 
In fact, the fast fading scenario of [1] can be obtained as a particular case of the current setup, by allowing a large number 
of blocks per frame M ^ oo (corresponding to an infinite number of subchannels). In doing so, the different frames are no 
longer characterized by their respective channel realizations, but instead they become long enough to display the statistical 
properties of the channel coefficient and thus become equivalent. This is why our present parallel slow fading scenario is 
more involved than the fast fading model of Part I of this paper [1], especially when it comes to resolving the optimal power 
allocation between different frames. Sometimes this additional complexity leads to an additional level of power control, as we 
shall see in Section [IVl 

Our contributions are summarized below: 

• We first investigate the case where the receiver feeds back the channel state information (CSI) which becomes available 
to both transmitter and jammer. For the short-term power constraints case we show the existence of and find a Nash 
equilibrium of pure strategies. Note that for a two-person, zero-sum game, all Nash equilibria have the same value [12]. 
Since an equilibrium of pure strategies is also an equilibrium of mixed strategies, our Nash equilibrium of pure strategies 
provides the complete solution of the game. 

• For the case with long-term power constraints we find the maximin and minimax solutions of pure strategies, and show they 
do not coincide (hence the non-existence of a Nash equilibrium of pure strategies). Traditional methods of optimization. 
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Fig. 1. Channel model 
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such as the KKT conditions, cannot be appHed to solve for these solutions completely. Therefore we provide a new, 
more intuitive approach based on the special duality property discussed in Appendix II-D of the first part of this paper 
[1]. As argued in [1], Nash equilibria of mixed strategies may not always be the best solutions to jamming problems. 
A smart jammer could eavesdrop the channel and detect both the legitimate transmitter's presence and its power level. 
Therefore, we believe that the maximin and minimax problem formulations with pure strategies are of great importance 
in understanding and resolving the practical jamming situations (in the worst case, they provide upper and lower bounds 
on the system's performance). 

• The optimal pure strategies of allocating power between frames, for the maximin and minimax formulations, are found as 
the solutions of two simple numerical algorithms. These algorithms function according to two different techniques which 
we explain in the sequel and we dub as "the vase water filling problems". 

• Mixed strategies are discussed next. We show that for completely characterizing this scenario we need three different 
levels of power control. We then particularize and obtain numerical results for the special simple case with only one block 
per frame (M = 1). 

• Finally, we compare our results to the case when the channel state information is only available to the receiver. We derive 
a Nash equilibrium for M = 1, and show that unlike in the fast fading scenario (where CSI feedback brings negligible 
improvements), under our current parallel slow fading channel model, perfect knowledge about the CSI at all parties can 
substantially improve performance. 

The paper is organized as follows. Section [III deals with the short term power constrained problem when full CSI is available 
to all parties. Section Hill studies the scenario with long term power constraints and pure strategies under the same assumption 
of available CSI. Mixed strategies are discussed in Section |IVl For comparison purposes. Section |Vl presents results for the 
case with no CSI feedback. Finally, conclusions are drawn in Section [Vll 

II. CSI Available to All Parties. Jamming Game with Short-Term Power Constraints 

The game with short-term power constraints is the less complex of the two games we discuss in the sequel. In this game, 
the transmitter's goal is to: 

Minimize Fr{lM{h, P{h), J{h)) < R) 

Subject to PM(h) < V, with prob. 1 ^ ^ 
while the jammer's goal is to: 

Maximize Pr(/M(h, P(/i), J(/i)) < i?) 

Subject to JM(h) < J7, with prob. 1. ^ ^ 

We shall prove that this game is closely related to a different two player, zero-sum game, which has the mutual information 
between Tx and Rx as a cost/reward function: 

Maximize Im{^, P(h), J(h)) 



Subject to PM(h)<P, 



r Minimize luih, P{h), J{h)) 
\ Subject to JM(h) < J. 

This latter game is characterized by the following proposition: 

Proposition 1: The game of © and ^ has a Nash equilibrium point given by the following strategies: 

( (1 _ ^)+ if hm < 

^*(M= ' , (5) 
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if hm, < 



where 7^ and u are constants that can be determined from the power constraints. 

Proof: The proof is a straightforward adaptation of Section IV.B in [2], and is outhned in Appendix Jl ■ 

The connection between the two games above is made clear in the following theorem, the proof of which follows in the 
footsteps of [10] and is given in Appendix [J 

Theorem 1: Let P*{h) and J*{h) denote the Nash equilibrium solutions of the game described by ^ and Q. Then the 
original game of ([B, O has a Nash equilibrium point, which is given by the following pair of strategies: 

^^"^^ ~ \ Pa{hm) if hiU{R,V,J) ^'^ 

^y^^)-\r(hm) if h^u{R,v,j) 

where U{R,V,J) = {h G : Im{^, P*{h), J*{h)) > R}, and where Pa{h) and Ja{h) are some arbitrary power 
allocations satisfying the power constraints respectively. 

III. CSI Available to All Parties. Jamming Game with Long-Term Power Constraints: Pure Strategies 
The long-term power constrained jamming game can be formulated as: 

r Minimize Pr(/M(h, {P^}, { J^}) < i?) 

\ Subject to E[PM{h)] < V 

f Maximize Pr(/M(h, {P^}, {^m}) < i^) ..^x 

\ Subject to E[JM{h)] < J 

where the expectation is taken with respect to the vector of channel coefficients h = (/iq, ^i, • • • , ^m-i) ^ , and V and 
J are the upper-bounds on average transmission power of the source and jammer, respectively. 

Contrary to the previous short-term power constraints scenario, if long-term power constraints are used it is possible to have 
PmO^) > P for a particular channel realization h, as long as the average of PmO^) over all possible channel realizations is 
less than P. 

Let m denote the probability measure introduced by the probability density function (p.d.f.) of h, i.e., for a set j^/ C , 
we have m{s^) = f{h.)dh.. Integrating with respect to this measure is equivalent to computing an average with respect to 
the p.d.f. given by /(h), i.e., dm{h) = f{h)dh. 

Both transmitter and jammer have to plan in terms of power allocation, considering both the instantaneous realization and 
the probability distribution of the channel coefficient vector, as well as their opponent's strategy. 

If the number of blocks M in each frame is larger than 1, the game between transmitter and jammer has two levels. The 
first (coarser) level is about power allocation between frames, and has the probability of outage as a cost/reward function. This 
is the only level that shows up in the case of M = 1. The second (finer) level is that of power allocation between the blocks 
within a frame. 

An important comment similar to that in [1] needs to be made. We should point out that decomposing the problem into 
several (two or three) levels of power control, each of which is solved separately, does not restrict the generality of our solution. 
In proving our main results we take a contradictory approach. That is, instead of directly deriving each optimal strategy, we 
assume an optimal solution has already been reached and show it has to satisfy a set of properties. We do this by first assuming 
that the properties are not satisfied, and then showing that under this assumption at least one of the players can improve its 
strategy (and hence the original solution cannot be optimal). The properties are selected such that they are not only necessary, 
but also sufficient for the completely characterizing the optimal solution (i.e. there exists a unique pair of strategies that satisfy 
these properties). 
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A. Power Allocation between the blocks in a Frame 

In this subsection we only deal with the second (intra-frame) level of power allocation for the maximin and minimax 
problems. The first (inter- frame) level will be investigated in detail in the following two subsections. 

The probability of outage is determined by the m-measure of the set over which the transmitter is not present or the jammer 
is successful in inducing outage. This set is established in the first level of power control. Note that the first level power 
allocation strategies cannot be derived before the second level strategies are available. 

In the maximin case (when the jammer plays first), assume that the jammer has already allocated some power Jm to a 
given frame. Naturally, the transmitter knows Jm (the maximin problem assumes that the transmitter is fully aware of the 
jammer's strategy). Depending on the channel realization, the value of Jm, and its own power constraints, the transmitter 
decides whether it wants to achieve reliable communication over that frame. If it decides to transmit, it needs to spend as little 
power as possible (the transmitter will be able to use the saved power for achieving reliable communication over another set 
of positive m-measure, and thus to decrease the probability of outage). Therefore, the transmitter's objective is to minimize 
the power Pm spent for achieving reliable communication. The transmitter will adopt this strategy whether the jammer is 
present over the frame, or not. The jammer's objective is then to allocate Jm between the blocks such that the required Pm 
is maximized. 

In the minimax scenario (when transmitter plays first) the jammer's objective is to minimize the power Jm used for jamming 
the transmission over a given frame. The jammer will only transmit if the transmitter is present with some Pm - The transmitter's 
objective is to distribute Pm between blocks such that the power required for jamming is maximized. 

The two problems can be formulated as: 

Problem 1 (for the maximin solution - jammer plays first) 



max 

{Jm>0} 



^ M-1 

min Pm = — V Pm, 



^ M-1 

S.t. /M({Pm}, {Jm}) >i^ls.t.-- ^ < Jm] (H) 



m=0 

Problem 2 (for the minimax solution - transmitter plays first) 

M-1 



max 



min Jm = Jm, 

{j^>o} M 

m=0 



^ M-1 

S.t. lM{{Pm}dJm}) < ^js.t.^ < ^M- (12) 



These problems can be solved by methods very similar to those presented in the first part of this paper [1]. For the brevity of 
this presentation, we shall only point out the main results, and defer all proofs to the Appendix [III The following propositions 
fully characterize the solutions. 

Proposition 2: The optimal solution of either of the two problems above satisfies both constraints with equality. 

Proposition 3: (I) Take the game given by 0]) and dU and set the constraints to PmO^) ^ Pm,i and JM(h) < Jm,i- 
Denote the resulting value of the objective by ImO^, P{h)^ J{h)) = Ri- Then solving Problem 1 above with the constraints 
'h Xlm=o J^ — J]^^ lM{{Pm}, {Jm}) > Ri yiclds the objcctivc Pm = Pm.i- Moreover, any pair of power allocations 
across blocks that makes an optimal solution of the game in ^ and Q is also an optimal solution of Problem 7, and conversely. 

(II) Take the game given by ([3]) and (O and set the constraints to PM(h) < Pm,i and JM(h) < Jm,i. Denote the resulting 
value of the objective by /M(h, P{h)^ J{h)) = Ri- Then solving Problem 2 above with the constraints Xl^^o 

< Pmi 

and lM{{Pm}, {Jm}) < ^1 yields the objective Jm = Jm,i- Moreover, any pair of power allocations across blocks that 
makes an optimal solution of the game in ^ and ^ is also an optimal solution of Problem 2, and conversely. 

(III) If Jm,i is the value used for the second constraint in Problem 1 above, and Pm,i is the resulting value of the cost/reward 
function, then solving Problem 2 with Pm = Pm,i yields the cost/reward function Jm = Jm,i- Moreover, any pair of power 
allocations across blocks that makes an optimal solution of Problem 7, should also make an optimal solution of Problem 2, 
and conversely. 

Proposition 4: The optimal solutions of Problem 1 and Problem 2 above are unique. 

Proposition 5: (I) Under the optimal maximin second level power control strategies {Problem 7), the "required" transmitter 
power Pm over a frame is a strictly increasing, continuous, concave and unbounded function of the power Jm that the jammer 
invests in that frame. 
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(II) Under the optimal minimax second level power control strategies (Problem 2), the "required" jamming power Jm over 
a frame is a strictly increasing, continuous, convex and unbounded function of the power Pm that the transmitter invests in 
that frame. 

Although under the same transmitter/jammer frame power constraints Pm and Jm the second level optimal power allocation 
strategies for the maximin and minimax problems coincide, this result should not be associated with the notion of Nash 
equilibrium, since the two problems solved above do not form a zero-sum game, while for the game of (O and (fTOl) , first level 
power control strategies are yet to be investigated. 

As in [1], we shall henceforth denote the function that gives the "required" transmitter power Pm over a frame where the 
jammer invests power Jm by 3^m{Jm-, h) and its "inverse", i.e. the function that gives the "required" jamming power over a 
frame where the transmitter invests Pm by ^m{Pm-,^)- Note that unlike in [1], these functions are now also dependent on 
the channel realization h. A particular channel realization can be characterized in terms of the second level power allocation 
technique. For instance, considering the maximin problem, we can map each channel vector h to a unique curve 3^m{Jm) 
in the plane. That is, for fixed h, we increase the jamming power allocated to the frame from to oo, and compute the 
transmitter power ^m{Jm^ h) required for achieving reliable communication. We have already mentioned that, for any fixed 
h, 3^m{Jm) is a strictly increasing, continuous, concave and unbounded function. 

Next we take a closer look at the 3^m{Jm-,^) curves. By inspecting the proofs of Propositions [2] - [5l we notice that j 
denotes the index of the first block on which the jammer allocates nonzero power, while p is the index of the first block on 
which the transmitter allocates nonzero power (the blocks are indexed in increasing order of their squared channel coefficients 
hm, and both transmitter and jammer allocate more power to blocks with larger values of hm)- Note also that p < j. If for a 
given h we have p = j over an interval of Jm, then the S^m{Jm) curve is linear over that interval. However, if p < j, the 
curve is strictly concave. 

We can think of the 3^m{Jm) curve that characterizes a given channel realization h as being "built" in the following manner. 
We increase the jamming power allocated to the corresponding frame, starting from Jm = 0. We already know that without 
the jammer's presence the transmitter transmits over the "best" blocks , i.e. the ones having the largest channel coefficients. 
Even as the jammer starts interfering, its optimal strategy is such that the blocks with the largest coefficients remain the most 
attractive for the transmitter. However, they do become worse than before. Hence, if without the presence of the jammer the 
transmitter would normally ignore some of the blocks, as the jammer's power increases, those blocks may slowly become 
more attractive. At some point, the transmitter will choose to increase the number of blocks over which it allocates non-zero 
power (i.e. decrease p). Similarly, as the jammer's power Jm increases, the jammer moves from the best block to the best two 
blocks, and so on (i.e. the jammer decreases j). 

The transmitter's and the jammer's transitions do not have to be simultaneous. Recall that the relationship between the values 
of p and j decide whether the ^m{Jm) curve is linear or strictly concave over an interval of Jm- Therefore, we expect the 
^m{Jm) curves to look like a concatenation of linear and strictly concave segments, as in Figure [S] As Jm increases, the 
transmitter decreases the value of p whenever the slope of the ^m{Jm) curve can be decreased by this move and similarly, 
the jammer decreases the value of j whenever the slope can be increased. In other words, as Jm increases, the transitions 
from linear portions to nonlinear portions are caused by the transmitter, while the transitions from nonlinear to linear ones are 
caused by the jammer. 

In the remainder of this subsection we provide the simplest example of optimal power allocation between the blocks of a 
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frame. Namely, we look at the case when M = 2 - only two blocks per frame. 
Particular case: M = 2 

The case of M = 2 is the simplest and most intuitive illustration of the second-level power control strategy. Since we have 
already discussed the nice dual property between the second level minimax and maximin strategies, the following considerations 
refer to the maximin scenario only. The jamming power Jm has to be allocated between the two blocks in a way that maximizes 
the transmitter's expense, should it decide to achieve reliable communication over the frame. The jammer and the transmitter 
can each transmit over either one or both blocks. All possible situations are considered next. 

Let the two channel coefficients be ho < hi, and denote the transmitter's and jammer's powers allocated to the blocks by 
PojPi and Jo, Ji respectively. Also denote Xi = Ji -\- a]^, for i G {0, 1}, and c = ex.p{2R). If we take a closer look at the 
solutions dl]) and Q of the game in ^ and Q, and if we recall that the solutions of either of our maximin and minimax 
second layer power allocation strategies have a similar form (up to the constants r] and u), it is easy to observe that xo < xi 
and 1^ > 1^ . This fact is also noted in Appendix III-CI where the solution of Problem 1 is given again, with the new notation 
A = 1/7/ and 11 = v/r]. Throughout the rest of this subsection we shall refer to the notation in Appendix III-CI and the solution 
in (fTobl) and (fToTI) . 

If the transmitter is active over both blocks, then the constraint Im = R yields 

l + ^PoVl + ^Pi)=c, (13) 

Xo I \ Xi J 



and with (1 1021) in Appendix HTCl we obtain A = y 

Suppose that the jammer is only present on one block of the frame, then that is the block with coefficient hi. This implies 
Xo = cr|^, and xi = (2Jm + cr^). Under these assumptions, the transmitter will only transmit on the first block, (that is 
Po = 2Pm and Pi = 0) if and only if 



cf° fl < 1°, (14) 

ho hi ho 



which translates to c ^'^^^+^n) ^ ^ 



Otherwise, the transmitter is present over both blocks, performing water-pouring as in (I1Q2I) , with 



/ (2Jm+^^ (15) 

V hohl 

Note that the transmitter cannot be present only on the second block. 

If the jammer decides to allocate non-zero power over both blocks, its optimal strategy is such that xo/ho > xi/hi. If we 
also have xo/ho < c{xi/hi) (corresponding to A > xo/ho), then the transmitter is present over both blocks. In this case, we 
can particularize (1 1021) to M = 2 and obtain: 



P^= lc^^-^,form€{0,l}. (16) 



ho hi h 

Define the ratio r = ^j^- Since xo -\- xi = 2{Jm -\- cr]^), we can write 

p {JM+(T%){2^/^-r-l) .r^i xo 
hor + hi hi ho 

Setting the derivative of Pm with respect to r equal to zero, we get the unique solution 

2 

I , (18) 



_ / ^{hi - hof ^4.hohic - {hi - ho) 

^opt — 



2hoV^ J ' 

which provides the optimal allocation of the jamming power Jm between the two blocks. The value of Topt is between 1 (for 
ho = hi) and c (for ho = 0). Furthermore, PM{r) is strictly increasing for r G [1, Topt) and strictly decreasing for r G {vopt^ c], 
hence Topt is the maximizing argument in (fTTl) . 

(2J +cr^ ) cr^ 

This also implies that if Vopt- — ^ — — < 7^, the jammer's optimal strategy is to allocate all of its power to the second 

(2 J ^ +cr^ ) 

block. If, on the other hand, ropt- — ^ > 7^, then the jammer's best strategy is to allocate the power Jm such that the 
ratio r = {xo/ho) / {xi/hi) equals the optimal ratio Vopt- 
The remarks above conclude in the following algorithm: 

. If c ^^'^^^^N) < both transmitter and jammer will only transmit on the second block. 

, jf ^QJm+oIx ^ a| j.^^^(2iM±a%) ^ the jammer will allocate all its power to the second block, while the 
transmitter will transmit on both blocks. 
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If r 



opt ~ 



> the jammer will transmit over both blocks such that {xq / ho) / (xi/hi) 



I opt 



and the transmitter 



will also be present on both blocks. 



B. Inter-Frame Power Allocation 

In this subsection we present the first level optimal power allocation strategies. 
The Maximin Solution 

Under our full CSI, average power constraints scenario, the jammer needs to find the best choice of the set ^ C of 
channel realizations over which it should be present, and the optimal way JM(h) to distribute its power over such that 
when the transmitter employs its optimal strategy, the probability of outage is maximized. 

We already know that given the jammer's strategy, the optimal way of allocating the transmitter's power is such that reliable 
communication is first obtained on the frames that require the least amount of transmitter power. The jammer's optimal strategy 
is presented in Theorem [2] below. The theorem is complemented by the numerical algorithm and the intuition-building analogy 
that follows its proof. 

Theorem 2: It is optimal for the jammer to make Jm{^) satisfy the power constraint with equality. The optimal jammer 
strategy for allocating power across frames is to increase the required transmitter power, starting with those frames whose 
channel realizations exhibit the steepest instantaneous slope of the characteristic 3^m{Jm) curve. The jamming power should 
be allocated such that the required transmitter power over each channel realization where the jammer is present does not exceed 
a pre-defined level K. 

The optimal value for K that maximizes the outage probability can be found numerically, by exhaustive search in a compact 
interval of the positive real line. 

Proof: Our proof takes a contradictory approach. Instead of deriving the optimal strategy defined above in a direct manner, 
we show instead that any other strategy not satisfying the theorem's requirements is suboptimal. Let ^ C M:![^ denote the 
sets of channel realizations over which the transmitter and the jammer are present, respectively. 

Suppose the jammer picks a certain strategy Jm{^)- Since the transmitter's strategy is predictable, the jammer already knows 
the transmitter's optimal strategy. Under this optimal strategy, the transmitter picks a set of frames y over which it will invest 
non-zero power. This choice also results in a maximum level of required transmitter power that will actually be matched by 
the transmitter. Denote this level by K. 

Since the transmitter's strategy is the optimal response to the jammer's strategy, the required transmitter power should be 
larger than or equal to K over the set of frames where the jammer jams, but the transmitter does not afford to transmit. 

Otherwise, the transmitter would be wasting power and its strategy would not be optimal. 

But since the jammer knows the transmitter's strategy, and knows that the transmitter will not transmit over ^ \ 5^ , its 
optimal strategy should make the required transmitter power over ^ \ ^ at most equal to K. Otherwise the jammer would 
be wasting power. 




Fig. 4. Maximin vase filling. 
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We have seen how the jammer's power should be distributed over . Next we show that if the jammer's power allocation 

over ^ Pi ^ is not done according to the theorem, the jammer's strategy is not optimal. For this, we assume that the jammer's 
strategy does not satisfy the theorem's requirements, and provide a method of improvement (i.e. we prove sub-optimality). 

If the theorem is not satisfied, than there exist two sets C 5^ of non-zero m-measure such that^^^ > 

"^^dJM^^ V hi G and \\2 ^ and such that the required Pm is less than on and Jm > on 

Consider a small enough amount of jamming power (5 Jm, such that, for any channel realization h G j^/ |J we can modify 
the jamming power by bJu without changing the slope of the ^m{Jm) curve. Subtracting SJm from all frames in the 
jammer obtains the excess power SJM'm{^), which it can allocate uniformly over s^. The jammer's total average power 
remains unchanged. However, the required transmitter power over is increased (because the slopes of the ^m{Jm) 

curves corresponding to are all larger than the slopes of the ^m{Jm) curves corresponding to ^), and thus the modification 
results in a larger probability of outage. 

There exists a closed interval [^^Kmax] ^ ^+ which includes the optimal value of K. This observation is vital to the 
existence of a numerical algorithm that searches for the optimal K. Once such an interval has been set, we can fix the desired 
resolution and calculate the numerical complexity of the algorithm. We next show how the upper limit Kmax of this interval 
can be found. Consider the set of channel realizations S^q where the transmitter is active when the jammer does not interfere 
with the transmission. Next, find the value Kmax for which, when the jammer allocates its power J according to the rules of 
the theorem, we obtain a set C \ S^q. This means that the jammer's strategy under any K > Kmax has no influence 
upon the transmitter's strategy. Note that such a finite Kmax can be found whenever \ S^q has non-zero m-measure. ■ 

The algorithm in Table U which we used in generating our numerical results in Subsection IIII-CI helps shed more light 
into the practicality of Theorem [J] In the description of the algorithm, we assume discrete jamming power levels with 
k = 0, 1, . . . and = 0, as well as a discrete and finite channel coefficient space. As a consequence, there exists a finite 
number of ^m{Jm) curves, each characterizing one possible channel realization, and each completely determined by a finite 
vector whose components are the values of 3^m{Jm) for that particular channel realization. 

An intuitive description of the technique is given in Figure (U Consider the problem where the jammer has to pour water 
in a number of vases (a vase for each possible channel realization). The shape of each vase is such that the vertical section 
of its wall produces a concave curve similar to the corresponding 3^m{Jm) curve. The jammer can afford to spend a certain 
volume of water. The jammer wants to "annoy" the transmitter, which is deeply concerned with the sum of the heights that the 
water levels reach in the vases. Hence, the jammer tries to use its available volume of water, such that the sum of the water 
levels' heights is maximized. However, the jammer cannot pour all the water in the thinnest vase, because then the transmitter 
might just ignore that vase. Instead, the jammer has to set a height limit K which it should not exceed. The jammer pours 
the water a cup at a time, starting with the vase in which a cup of water rises the water level the quickest. In Figure HI the 
order of adding cups to the vases is shown by numerals from 1 to 11. The first cup is poured into the thinnest vase (vase A) 
and incidentally reaches the level K. Thus, no more water should be added to vase A. The next three cups are added to vase 
B, and then the next five cups to vase C. Then the jammer returns to vase B, and adds another cup, for this increases the 
water level more than it would increase the level in vase C. Finally, the last available cup is added to vase C. The way the 
numerical algorithm works is illustrated in the right part of Figure (H 

The Minimax Solution 

In Theorem [3] we showed that given the transmitter's and the jammer's powers Pm and Jm allocated to a frame, the optimal 
strategies for distributing these powers inside the frame are identical for the minimax and the maximin problems. Hence, by 
rotating the 3^m{Jm) plane, we get the characteristic ^m{Pm) curves for the minimax problem. 

We already know that given the transmitter's strategy, the optimal way of allocating the jammer's power is such that outage 
is first induced on the frames that require the least amount of jamming power. 

The transmitter's optimal strategy is presented in the following theorem, which is complemented by the numerical algorithm 
and the analogy that follows its proof. 

Theorem 3: It is optimal for transmitter to make Pm{^) satisfy the long-term power constraint with equality. The optimal 
transmitter power allocation across frames is to increase the required jsimmmg power up to some pre-defined level K, starting 
with those frames on which the required transmitter power to achieve this goal is least. 

The optimal value for K that minimizes the outage probability can be found numerically by exhaustive search. 

Proof: As in the case of Theorem [2l we take a contradictory approach. Instead of directly deriving the optimal strategy 
defined above, we show that any other strategy not satisfying the theorem's requirements is suboptimal. Recall that y and ^ C 
R^ denote the sets of channel realizations over which the transmitter and the jammer are present, respectively. 

Suppose the transmitter picks a certain strategy PmO^)- Since the jammer's strategy is predictable, the transmitter already 
knows the jammer's optimal strategy. Under this optimal strategy, the jammer should pick a set of frames ^ over which it will 
invest non-zero power. This choice also results in a maximum level of required jamming power that will actually be matched 
by the jammer. Denote this level by K. 
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TABLE I 

Numerical algorithm for deriving the maximin solution. 

Let P denote a matrix with each row representing one of the 
vectors ^m{Jm)^ for different channel reahzations h. Let 
Preq bc thc vcctor of required powers for the different frames. 
The initial Preq is set equal to the first column of P. Let 
Kmax be the upper limit when searching for the optimal K. 
Initialize K = 0. 
while K < Kmax 
Pt = 0. 

Let L be an index vector, the same size as Preq- 
Initialize all components of L to be equal to 1. 
We have the relationship Preq{j) — P(i, L{j)). 
% Jx strategy: 

The amount of jamming power spent at each step is accumu- 
lated into the variable Jc. 

while Jx power constraint is satisfied {Jc < J) 

Find row j of P with the largest difference 

between components L{j) + 1 and L{j), 

and such that P(j, L{j) + 1) < K. 

Preq{j)=P{j,L{j) + l). 
m = m + L 

Weigh by probability of row j and add to Jc. 

end 

% Tx strategy (Tx picks frames where required power is 
minimum first) 

The amount of transmitter power spent at each step is simu- 
lated into the variable Pc. 

while Tx power constraint is satisfied (Pc < V) 

Pick the least component of Preq. 

Add probability of corresponding frame to pr. 

Add value of component, weighted by 

probability above, to Pc. 

Delete component from Preq. 

end 

Pout{K) = 1 - PT 

Increment K. 

end 

Select K that produces the largest Pout. 



Since the jammer's strategy is optimal, the required }a.mming power outside the set ^ should be larger than or equal to K. 
Otherwise, the jammer would be wasting power and hence its strategy would not be optimal. 

But since the transmitter knows the jammer's strategy, it also knows that the jammer will not be present over ^ \ so 
the transmitter should make the required jamming power over ^ \ ^ at most equal to K. Otherwise the transmitter would 
be wasting power. Hence, over ^ \ ^ the transmitter should allocate power such that the required jamming power is equal 
to K. 

Next we show that if the transmitter's power allocation over ^ P| ^ is not done according to the theorem, the transmitter's 
strategy is not optimal. For this, we assume that the transmitter's strategy does not satisfy the theorem's requirements, and 
provide a method of improvement (i.e. we prove sub-optimality). 

If the theorem is not satisfied, than there exist two sets ^ C ^ P| ^ of non-zero m-measure such that Pm (hi, i^) < 
Pm{^2^K) V hi G and h.2 G and such that the required Jm is less than K on and Jm > on ^ cannot be part 
of the minimax solution. Denote the original transmitter power allocation functions over and ^ by P^ Q(h) and P^ Q(h) 
respectively. 

For any hi G h2 G ^ and Jm,i, Jm,2 < K, we have: 



PM(hi,K)-PM(hi, Jm,i) " PM(hi,i^) 

^ J^^^ (19) 

PM(h2,i^) - PM(h2,JM,2)' ^ 

where both a) and c) follow from the convexity of ^m{Pm) - Proposition [5] - and h) follows from the assumption in the 
beginning of this proof. 

If the transmitter cuts off transmission over a subset C it obtains the excess power j^, PM{h.)dm{h), which it can 
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allocate to a subset s^' 



C £^ such that the required Ju is equal to K over s^' , i.e. 



/ P^,o(h)^m(h) = / [PM(h, K) - P^,o(h)] ^m(h) 



(20) 




Replacing Pm (hi, Jm,i) by P^Q(h) and Pm (h2, Jm,2) by P^Q(h) in ([T9l ), we see the transmitter improves its strategy 
by forcing the jammer to allocate more power to the set j^/ |J and hence decreases the probability of outage. Note that 
since ^' (Z 5^ set ^' is in outage, regardless of whether the transmitter is present or not. Thus, transmitter does 

not increase Pout by cutting off transmission on 

There exists a closed interval [0, Kmax] ^ which includes the optimal value of K. As in the maximin case, the existence 
of such a closed interval is required for constructing a numerical algorithm that searches for the optimal K. The upper limit 
Kmax of this interval can be found and updated as follows. First solve the problem for an arbitrarily chosen Kq, and determine 
the set ^0 \ ^ over which the transmitter achieves reliable communication. We can set Kmax equal to the value of K that 
yields a set y of the same m-measure as the set \ ^o- Note that if K is increased over this Kmax, the outage probability 
is at least as large as that obtained for K = Kq (and hence Kq is a better choice). ■ 

The algorithm in Table |II] which we used for our numerical results in Subsection IIII-CI illustrates the application of Theorem 
O In the description of the algorithm, we assume discrete jamming power levels with /c = 0, 1, . . . and = 0, as well 
as a discrete and finite channel coefficient space. As a consequence, there exists a finite number of 3^m{Jm) curves, each 
characterizing one possible channel realization, and each completely determined by a finite vector whose components are the 
values of 3^m{Jm) for that particular channel realization. 

A description of the technique is given in Figure [51 using the same vase analogy as in the maximin case. This time, the 
transmitter does the pouring. Its obsession with the sum of the heights of the water levels imposes a constraint on this sum. 
Under this constraint, the transmitter wants to use as much of the jammer's water as possible. That is, the transmitter attempts 
to maximize the volume of water that can be accommodated by the vases, under the constraint that the sum of the water levels' 
heights is less than some given value. Moreover, if the transmitter pours water only in the thickest vase, it might not feel that 
it did enough damage to the jammer. Thus, the transmitter needs to set a limit K. The optimal strategy is to fill (up to volume 
level K) the thickest vase first (note that "thickest" refers to the fact that when filled up to volume level K, the vase displays 
the lowest water level height, thus "thickest" is defined with respect to K). The order in which the transmitter adds cups of 
water to the vases is depicted in Figure [5] by numerals from 1 to 12. The way the numerical algorithm works is illustrated in 
the right part of Figure [51 

Particular case: M = 1 

For this simple scenario, there is no second level of power allocation. All frames consist of only one block, and the Pm{Jm) 
curves have the particular affine form with parameter h (the squared channel coefficient corresponding to this block): 



Pm 



exp(i?) - 1 
h 



(Jm + cfn)' 



(21) 




p. 



Fig. 5. Minimax vase filling. 



12 



TABLE II 

Numerical algorithm for deriving the minimax solution. 

Let P denote the matrix with rows representing the ^m{Jm) 
vectors for different channel reahzations h. Let Kmax be value 
where searching for the optimal K stops. 
Initialize K = 0. 

while K < Kmax 
% Tx strategy: 

The amount of transmitter power spent at each step is accu- 
mulated into the variable Pc. 
Initiahze K = Jm- 
Initialize Pc = 0, pt = 0. 
while Tx power constraint is satisfied (Pc < V) 

Find row j of P with least /c-th component. 

Add probability of row j to pr- 

Add value of the /c-th component, weighted 

by the probability above, to Pc. 

Delete row j from matrix P. 

end 

% Jx strategy (Jx jams frames where Tx is present, randomly, 
until it reaches its power constraints): 
PJ = f . 

Pout{K) =PT -PJ. 

Increment K. 

end 

Select K that produces the least Pout- 



Since the slopes of the Pm{Jm) curves are constant with Jm and the frames with smaller values of the channel coefficients 
have larger characteristic slopes, we can easily particularize Theorems [2] and [51 

With the same notation ^ C M+ for the set of channel realizations over which the jammer invests non-zero power and 
C M+ for the set of channel realizations over which the transmitter uses non-zero power, we can now define the optimal 
power allocation strategies. 

For the maximin scenario. The jammer should deploy some Jm(^) over ^ such that the required Pjwih) is constant over 
the whole interval The purpose of the jammer being active over ^ \ ^ is to "intimidate" the transmitter. The transmitter 
plays second, and hence takes advantage of the jammer's weaknesses. It always chooses to be active on the subset of ^ on 
which the required Pjviih) is least. This is why the optimal jammer strategy is to display no weakness, i.e. to make Pm(^) 
constant over These considerations are formalized in Proposition [6] below. 

Proposition 6: In the maximin scenario, the jammer should adopt such a strategy as to make the transmitter's best choice 
of y intersect ^ on the the left-most part of and the required transmitter power equal to some constant i^T on ^ P| ^ 
and to (c - l)a%/h on ^ \ ^. 

Transmitting Jm(^), satisfying the power constraint with equality, such that the transmitter power required for reliable 
communication is Pm(^) = K,yh G and Puih) = (c - l)cr%/h,yh G [0, oo) \ (/ii,/^^], for some < e IR+ 

and some constant K G IR+ U{^} optimal jammer strategy for the maximin problem. (Note that Pnih) should be 

continuous at hi.) 

The values h\ and /ij that maximize the outage probability can be found by solving the following problem: 

poo 

Find min / f{h)dh, where 

^ Jho 

rh2 roo ^ _ i 

ho is given by / Kf{h)dh + / --—a%f{h)dh = V, (22) 

Jho Jh2 ^ 

C — 1 o 

hi is given by hi = —t^cfn^ (23) 
A 

rh2 / 



and h2 is given by j y - aj^j f(h)dh = J. (24) 

The power allocation is depicted in Figure [6l The convex decreasing curve represents the original required transmitter power, 
without the presence of a jammer and satisfies the equation Pm = {c — l)a]^/h. Notice how by picking some K, we can 
determine hi, h2 and ho (in this order), and then find the probability of outage as Pout{hi) = 1 — xn[{ho^ oo)]. The optimal 
K, resulting in hi, /ij and /iq, is the one minimizing the m-measure of the set {ho^ oo). 
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K ^2 

Squared channel coefficient h 



Fig. 6. Maximin solution for M = 1 - power distribution between frames 



For the minimax scenario the jammer will not transmit any power over a frame if outage is not going to be induced or if the 
transmitter is not present, i.e. ^ C The jammer will start allocating power to the frames over which an outage is easiest 
to induce, and go on with this technique until the average power reaches the limit set by its power constraint. Obviously, the 
jammer prefers the frames for which the required Jm(^) is less. The optimal transmitter's strategy is to allocate its power 
such that the required Jm(^) is constant on the whole set and hence to display no weakness. 

These considerations are formalized in Proposition [7] below. 

Proposition 7: For the minimax scenario, the transmitter's optimal way to allocate its power is to make the required jamming 
power remain equal to some constant K on all of Transmitting PM{h), satisfying the power constraint with equality, such 
that the required Jjviih) equals K for h e [/i*, oo), and Jjviih) = V/i G [0, /i*), for some /i* G IR+, is an optimal transmitter 
strategy for the minimax problem. The values K and /i* that minimize the outage probability can be found by solving the 
following problem numerically: 

/•oo 

Find max / f{h)dh, where 
ho is given by / Kf{h)dh = J, (25) 
/i, is given by H i^^^}i^±^ f{h)dh = V. (26) 

■ 

The numerical problem is described in Figure [71 Notice how by picking some K, we can determine hx and ho (in this 
order), and then find the probability of outage as Pout {hi) = 1 — m[(/io,oo)]. The optimal K, resulting in h* and ho, is the 
one maximizing the m-measure of the set {ho^oo). Note that the jammer does not necessarily have to jam on an interval of the 
form [hxj ho]. The jammer's choice space (the set of frames out of which the jammer picks its set ^) is an indifferent one, 
i.e. the jammer can randomly pick ^ C [hx, oo) as long as its measure satisfies Km{^) = J . However, for the purpose of 
computing the outage probability, the representation of ^ as an interval is convenient and incurs no loss of generality. 

C Numerical Results 

We have computed the outage probabilities for both minimax and maximin problems when M = 1 and M = 2. The channel 
coefficients are assumed i.i.d. exponentially distributed with parameter A = 1/6. Figure [8] shows the outage probability vs. the 
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Fig. 7. Minimax solution for M = 1 - power distribution between frames 



maximum allowable average transmitter power V for fixed J' = 10 when R = 1. 

For comparison purposes, we also plotted the results for the case when M = oo, which are readily available from Part I of 
this paper [1]. 

Numerical results demonstrate a sharp difference between the minimax solutions and the maxmin solutions, which demon- 
strates the non-existence of Nash-equilibria of pure strategies for our two-person zero-sum game with full CSI. 

Note the behavior of the outage probability when the number of blocks per frame M is increased. At low transmitter powers, 
the increase of M produces an increase in the outage probability for both the minimax, and the maximin scenarios. 

On the contrary, at higher transmitter powers a lower outage probability is obtained for both the minimax and the maximin 
cases when M is larger. This behavior can be summarized as follows: the more powerful player will use the available diversity 
to its own advantage. 

IV. CSI Available to All Parties. Jamming Game with Long-Term Power Constraints: Mixed Strategies 

We have already seen that the maximin and minimax solutions of the jamming game when only pure strategies are allowed 
do not agree, and thus our game has no Nash equilibrium of pure strategies. However, recall that the solution of the minimax 
problem with pure strategies can often be a good characterization of a practical jamming situation (e.g. when the jammer does 
not transmit unless it senses that the transmitter is on) and can always serve as a lower bound on the system's performance. 

This aside, a Nash equilibrium is still the preferred characterization of jamming games, and since such an equilibrium exists 
for our problem only when mixed strategies are allowed, the current section is dedicated to the derivation of such a saddlepoint. 

Unlike the fast fading scenario of [1], the frames in our slow-fading parallel-channels model are not equivalent. Each frame 
is characterized by a different realization of the channel vector h. This is why our present scenario is even more involved than 
the one in [1], and requires three levels of power control instead of two. 

As before, our approach to the problem is a contradictory one. We study the power control levels starting with the "finest" 
one, and show that if our conditions for power allocations are not satisfied, then the strategy is suboptimal. The reason why 
an additional (third) level of power control appears here is a combination of the facts that we study mixed strategies and 
the frames are not all equivalent as in [1]. Namely, to cover all possible probabilistic strategies, we need to dedicate a level 
of power control to the power allocation between frames with the same channel realizations (i.e. equivalent frames) and an 
additional level of power control for the power allocation between frames with different channel realizations. Along with the 
power allocation within frames, these problems cover all possible cases. 
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Fig. 8. Outage probability vs. P for M = 1 and M = 2 and M ^ oo when J = 10 - minimax and maximin cases. We take R = 2. 



A. Power allocation within a frame 

The third level of power control deals with the optimal power allocation between the blocks in a frame, once the transmitter 
is given the channel vector h characterizing the frame and allocated power Pm, and the jammer is given the channel vector 
and its allocated power Jm- 

At this point, the third level of power control resembles the two-player, zero- sum game of ([3]) and ^ having the mutual 
information calculated over a frame Im as cost function. However, none of the players knows the other player's constraints, 
because (Pm, Jm) is a random event. Theorem |4] below provides the optimal transmitter/jammer strategies for power allocation 
within a frame. 

Theorem 4: Given a frame with channel vector h and a realization (pmjJm) of (Pm, Jm), let ^mUm) denote the solution 
of Problem 1 in Section Hill with Jm = Jm, and ^m{pm) denote the solution of Problem 2 in Section Hill with Pm = Pm- 

The transmitter's optimal strategy is the solution of the game in ^ and d?]), where the jammer is constrained to Ylm^i — 
^m{pm) and the transmitter is constrained to Ylm^i < Pm- The jammer's optimal strategy is the solution of the 
game in © and (|4|, where the transmitter is constrained to — ^mUm) and the jammer is constrained to 

Proof: The proof is very similar to the proof of Theorem 5 of [1] and is deferred to Appendix HIJ ■ 

B. Power allocation between frames with the same channel vector 

Due to the form of the optimal second level power allocation strategies described in the previous subsection, the probability 
that a given frame is in outage can be expressed as 

PoutM = MJm > /m{Pm)} = 

= l-Pr{PM>^M{JM)}. (27) 
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where PmUm) is the strictly increasing, unbounded and concave function (see Proposition [5]) that characterizes the frame. 
Note that a pair of strategies can only be optimal if Pout,h above is the Nash equilibrium of a jamming game played over the 
frames characterized by the same channel vector h. This means that if the transmitter and jammer decide to allocate powers 
PM,h and JM,h respectively to frames with channel vector h, they should not allocate the same amount of power to each 
of these frames. Instead, they should use power levels given by the realizations of two random variables Pm and Jm with 
distribution functions {Fp{pm)^ FjUm)) given in the following theorem. 

Theorem 5: The unique Nash equilibrium of mixed strategies of the two-player, zero-sum game with average power 
constraints described by 

min max Pout,h, (28) 

Fp (pM ) :Efp Pm<Pm (h) Fj ( jm ) :Ef^ Jm < Jm (h) 

where E^^p and E^?^ denote expectations with respect to the distributions Fp{pm) and Fj^jm), is attained by the pair of 
strategies {Fp{pm), Fj{jM)) satisfying: 

Fp{^M{y)) - kpV{[0, 2v]){y) + (1 - kp)Ao{y), (29) 



Fj{^m{x)) - ^,U([0, Jm{2v)]){x) + (1 - kj)Ao{x), (30) 

where U([r, denotes the CDF of a uniform distribution over the interval [r, t], and Ao(-) denotes the CDF of a Dirac 
distribution (i.e. a step function), and the parameters kp^kj G [0,1] and v G [max{ JM,h, ^M(^M,h)/2}, oo) are uniquely 
determined from the following steps: 

1) Find the unique value vq which satisfies: 

PM,hJM,h = [^m(2^o) - PM,h](2vo - JM,h). (31) 

2) Compute 5(^o) = ^M{y)dy - 2voPM,h- 

3) If S{vo) < 0, then v is the unique solution of 

/ ^M{y)dy-2vPMM = ^. (32) 
Jo 

kp = 1 (33) 

and 

' 2v[0^m{2v)-Pmm\' 

4) If S{vo) = then v = vo, kp = kj = 1. 

5) If S{vo) > 0, then v is the unique solution of 

r2v 

■!^M{y)dy-^M{2v){2v-JM,h) = 0, (35) 



/ 

^0 



and 



2vPmm .... 
e^M{2v)[2v-JMM] 

kj = l. (37) 

Proof: The proof follows directly from Theorem 9 in Appendix III of [1], by substituting x = Pm, y = Jm, 
g{y) = 3^M{y), 9~^{x) = ^m{x), a = PM,h and b = JM,h- It is also interesting to note that the condition g{y)dy < 
Ig{b) 9~^{x)dx is satisfied because 3^M{y) is unbounded. ■ 

Particular case: M = 1 

For M = 1 the first (intra-frame) level of power control is inexistent. For a given channel realization h we can readily derive 
the affine function PmUm) in (1271) as 

PmUm) = ^^Um + (38) 

where c = exp(i?). If we use the particularization of the general solution of Theorem [5] to affine functions, as in the last part 
of Appendix III of [1], we obtain the outage probability as 
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Pout,h — 1 



hPMjh) 
c-1 



1 + 2 



and 



'1 + 2 



out,h 



^2 



\JM(h) 

' hPMjh) V 
c-1 



hPMjh) ^1 . 



1 + Wl + 2- 



The transmitter and jammer strategies that achieve these payoffs are such that 

Fp{x) ^ kpV{[^a%,2v^ + ^a%]){x) + 



2v 



+ {l-kp)Ao{x), 



(39) 



(40) 



The parameters kp^ kj G [0, 1] and v G [max{ JM(/i^), ^'^(Pm(^))/2}, oo) are uniquely determined from the following steps: 
1) If 



then 



1+ Wl+2 



'AT 



2al 



N 



2 



(41) 



(42) 



and 



2) If 



then 



2vPM{h) 



^{2v + a%){2v-JM{h)) 



kj = 1. 



1 + A 1 + 2 



'AT 



JMih) 



PM{h) - ^CT% 



2 



(43) 



(44) 



(45) 



(46) 



and 



kr) 1 



kj — 



^J^{h){2PM{h) - ^<T%) 



(47) 



(48) 



2(Pm(M - • 

The special form of this solution will be used in the next subsection to derive the overall Nash equilibrium of the mixed 
strategies game for M = 1. 
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C Power allocation between frames with different channel vectors 

In the previous subsections we have described the optimal power control strategies for given particular channel realization 
h, and transmitter and jammer power levels PM,h and JM,h respectively. The first level of power control, which is the subject 
of this subsection, deals with allocating the powers specified by the transmitter and jammer average power constraints V and 
J between different channel vectors. In other words, we are now concerned with solving the problem 



min max Eh 

PM(h):EhPM(h)<'P JM(h):Eh JM(h)<:7 



OUt^h.^PM{^)iJM{ 



h)] 



(49) 



where Pont,h,PM(h),jM(h) (also denoted as Pout,\i) is the outage probability of a frame characterized by the channel vector h 
and to which the transmitter allocates power PM(h), and the jammer allocates power JM(h). Note that Pon^,h,PM(h),JM(h) 
can be easily computed according to the second and third levels of power control already presented. 

However, the Nash equilibrium of the game in (|49l) above is highly dependent on the result of the second level of power 
control. Since finding a closed form solution for the second level is still an open problem, a general solution for the first level 
of power control is not available at this time. 

However, we next provide a Nash equilibrium for the particular case when M = 1. 

Particular case: M = 1 

We start by pointing out the following important property of the second-level power control strategies for M = 1. 

Proposition 8: The outage probability Pout.h given in (l39l) and (l4Ql) above is a continuous function of both arguments. 
Moreover, Pout.h is a strictly decreasing, convex function of Pm(^) for fixed Jnih) and a strictly increasing, concave 
function of Jm(^) for fixed PM{h). 

^ir by 



Proof: In the remainder of this section we shall denote the case when ^^^[^^ < \JM(h) 



1 



Case 1 and the case when 



hPM{h) 



' JMih) 



a]^ by Case 2. 



It is straightforward to check that when 



c-1 



1 



1 + 2 



a% we get P, 



out,h 



using either of the relations in ([39l) or (|4Q|) . Thus, the continuity of Pout.h follows immediately. 
If we evaluate the derivatives for Case 1 

h 



by 



I+A/1+2 



dPr 



out,h 



dPM{h) 



JM{h) 



1 



1 



(50) 



'N 



and for Case 2 



out,h 



dPM{h) 2{PM{h)-^a%y 



(51) 



we note that when Jm(^) is fixed, Pout.h is a strictly decreasing function of PM{h), affine in Case 1 and strictly convex in 



Case 2. Moreover, 



dPout,h 
dPM{h) 



is continuous, which makes Pout,h an overall strictly decreasing, convex function of Puih). 



Similar (but symmetric) properties hold for the derivatives 

dPout.h 



dJuih) 



1 



' JMih) 

PM{h) 



'N 



1 + 2 



JMih) 



for Case 1 and 



dP, 



out,h 



dJM{h) 



'-PM{h) 



(52) 



(53) 



for Case 2, yielding Pout,h an overall strictly increasing, concave function of Jm(^) (strictly concave in Case 1 and affine in 
Case 2). ■ 
The result of Proposition [8] implies that the overall outage probability FihPout,h is a convex function of {PM{h)} for fixed 
{JM{h)} and a concave function of { Jm(^)} for fixed {Pm(^)}- Since the set of strategies {PM{h)^ JM{h)} is convex, there 
always exists a saddlepoint of the game in (|49l) [13]. The importance of this result should be noted, since it implies that a Nash 
equilibrium of mixed strategies of the two-person, zero-sum game in (|49l) can be achieved by only looking for pure strategies. 
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Recall that any Nash equilibrium of pure strategies is also a Nash equilibrium of mixed strategies, and that for a two-person, 
zero-sum game all Nash equilibria share the same value of the cost function [12]. 

Any saddlepoint of (|49l ) has to satisfy the KKT conditions associated with the maximization and minimization problems 
of (|49l ) simultaneously. The next Proposition shows these KKT conditions are not only necessary, but also sufficient for 
determining a saddlepoint. The proof is deferred to Appendix |llll 

Proposition 9: For our two-player, zero-sum game of (|49l ), any solution of the joint system of KKT conditions associated 
with the maximization and minimization problems yields a Nash equilibrium. 

We can now solve the KKT conditions associated with the maximization and minimization problems of (|49l ) simultaneously. 
For Case 7, these are 



h 

c-l 



and 



' JM{h) 



h 
c-l 



+ A-7(/i) =0 



(54) 



JM{h) 



PM{h) 



JMih) 

+ li-S{h) = 0, 



(55) 



' JMih) 



where j{h) and S{h) are the complementary slackness conditions satisfying 7(/i)Pm(^) = and S{h)JM{h) = 0, and where 
/i, A > 0. From (1551) we get 



A 



Juihy 



resulting in 

JM{h) 

which in combination with (l54l) yields 



h fi fi{c — 1) 



12A2 



2h 



Puih) 

where we denote = max{x, 0}. Under this solution, the condition for being under Case 7, 

hPM{h) 



c-l ^2^-(^) 



1 



'1 + 2 



2 



(56) 



(57) 



(58) 



(59) 



translates to 



2iih 



A(c-l) 



< 1 



= 2(l + a^/i). 



Note that Pm(^) = if and only if Jjvrih) = 0, and this happens when h < h^/i, where 

^0/1 = A(c- l)cr|^. 

Writing the KKT conditions for Case 2 under the assumption that Pm(^), JM{h) > we obtain 



and 



2(^Pm(M-<)' 



2[^,PM{h)-a%) 



+ A - 7(/i) = 



+ 11- 5{h) = 0, 



(60) 



(61) 



(62) 



(63) 
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which yield 



and 



-1 A 



2/i 



2 



(64) 



(65) 



Note that in this case both Pm(^) and Jjviih) are strictly positive for finite h. Under this solution, the condition for being 
under Case 2, 



hPMjh) 1 

> 2 J^mW 




^2 



translates to 



A(c-l) 



> 1 




A(c-l)- 



(66) 



(67) 



Forcing the right-hand side of (l60l) to equal the right-hand side of dSTl) we get the value of which is at the boundary 
between Case 1 and Case 2: 



/^i/2 = A(c-l)(-+a|^). 



(68) 



A close inspection of the expressions of PM{h) and Jjviih) for the two cases shows that they are both increasing functions of 
h under Case 1 and decreasing functions of h under Case 2, and moreover, they are both continuous in /11/2. To summarize the 
results above, the optimal transmitter/jammer first level power control strategies are given in ([69l) and (TTQI) below, respectively. 
The constants A and ji can be obtained from the power constraints F/hPnih) = V and F/hJuih) = J. 



PM{h) 



0, 



if 



h<h^ 



_ /i(c-l) ^2 



0/1 



c-1 2A2 2^ 



AT' 



if ho/i < h < hi/2 
if h > hi 12 



(69) 



JM{h) 



if 



-1 A 
^ 2/i' 



^ < /^O/l 



2h ^n)'^ + ^AT - ^AT' if ^0/1 < ^ < ^1/2 

if > hi/2 



(70) 



Z). Numerical results 

Figure [9] shows the probability of outage obtained under the mixed strategies Nash equilibrium, versus the transmitter power 
constraint V, when M = 1, for a fixed rate R = 1, noise power a% = 10, a jammer power constraint J = 10 and a channel 
coefficient distributed exponentially, with parameter A = 1/6. The maximin and minimax solutions of the pure strategies game 
are shown for comparison. 

As expected, the solution of the of mixed strategies game is better (from the transmitter's point of view) than the minimax 
and worse than the maximin solutions of the pure strategies game. 



V. CSI Available Receiver Only. Jamming Game with Long-Term Power Constraints: Mixed Strategies 

In this section we investigate the scenario when the receiver does not feed back any channel state information. Since we 
have already shown that the problem with long-term power constraints is the more interesting and challenging one, and since 
the purpose of this section is to offer a comparison with previous results, we further focus only on the scenario of average 
power constraints and mixed strategies. 

Unlike in the corresponding Section V of [1], where all frames were equivalent because of the fast fading channel, in our 
present scenario each frame is characterized by a particular channel realization. Since this channel realization is not known to 
either the transmitter or the jammer, they both have to allocate some power over each frame, in a random fashion, such that 
the transmitter minimizes and the jammer maximizes the probability that the mutual information over the frame is less than 
the transmission rate R. In its most general form, the game can be written as 
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'^out ^ J=10,G^=10, h distributed exponentially with parameter ?l= 1/6; receiver CSI only 
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Fig. 9. Outage probability vs. transmitter power constraint 7^ for M = 1 when J' = 10, R = 2, aj^ = 10 and h is distributed exponentially, with parameter 
A = 1/6. 



min max Ep^,j^ 

Pm:^Pm<V Jm:^Jm<J 



mm max 

<MPm Jm.:T.Jm.<JM 



M-1 . . 

Pr{ y log ( 1 + _£^^ ) < Mi?} 



(71) 



where Ep^ denotes statistical expectation with respect to the probabiHty distribution of Pm and Jm- The form of (TtTI) 
suggests two levels of power control: a first one which deals with the allocation of power between different frames, and a 
second one which allocates the powers within each frame. 

In solving the game, we start as before with the second level of power control. However, this level requires an exact 
expression of Pt{Y^^ZI log i} ^ T^+^) — ^^}- Note that this probability depends upon the probability distribution of 
the channel vector h. A practical way of solving the problem is the following. 



Denote Sn 



= log (l 



the random variable (depending on hm) which characterizes the instant mutual information 



over the m-th block of the frame. We can write the cumulative distribution function (c.d.f.) of Sm as 



Fs^{x) = Pr{S^ < x} 



Pr{hm < (e" - 1) 



Jn 



'N ■ 



}=FJ{e--l) 



Ji 



'N 



(72) 
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where Fh{x) is the c.d.f. of the channel coefficient hm and we assume that the channel coefficients over all the blocks of a 
frame are independent and identically distributed random variables. 
We can now compute the p.d.f. (assuming it exists) of Sm as 



dx 



Finally, our probability can be written as 



M-l 



Pr{ 5] log 1 



P h 



Jn 



- crt 



dx 



< MR} 



(73) 



m=0 ^ ' 

= (F5o*/5,*...*/5M-i)(Mi?) (74) 

where * denotes regular convolution. Due to the intricate expression of this probability, as well as its dependence on the 
statistical properties of the channel, we next focus exclusively on the simple case when M = 1. 

Particular case: M = 1 

For M = 1, we are only concerned with the first level of power control. The game can be written as 

min max 

Pm:'E.Pm<V Jm:'E.Jm<J 
2 



E 



Pm,Jm 



Pr{P<(c-l) ^^^^^ } 



(75) 



or equivalently. 



mm max 

Pm:^Pm<V Jm-^Jm<J 



E 



Pm,Jm 



Pr{h < (c- 1) 



Jm + crj^ 
Pm 



(76) 



In order to provide a good numerical comparison with the results of the previous sections, assume that the channel coefficient 
h has an exponential probability distribution with parameter A. Its cumulative distribution function can thus be written as 
F{h) = 1 — e~^^, which enables us to write 



Pr{h < (c - 1) 



Jm + ^at I _ 



Denote H{Pm, Jm) = ^ — exp 
By computing the derivatives 



-A(c-l) 



= 1 — exp 

JM-\-cr\ 



-A(c-l) 



Jm + cr^ 



M 



Pm 



dH 



-A(c-l) 



Jm + 

^M 



exp 



-A(c-l) 



Jm + 



N 



Pm 



< 0, 



dP^ 



A(c-l) 



Jm + cr 



N 



p3 
^M 



exp 



A(c-l) 



Jm + cr' 



N 



M 



-A(c-l) 



Jm + cr 



N 



M 



f 2 
>0, 



(77) 



(78) 



(79) 



dH 

dJM 



= A(c- 1)-— exp 

-t^M 



-A(c-l) 



Jm + o" 



N 



M 



>o, 



(80) 
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and 



-(A(c-l) — )2exp 



M 



-A(c-l) 



Jm + CF 



2 

AT 



M 



(81) 



we notice that H is sl strictly decreasing, convex function of Pm for a fixed Jm, and a strictly increasing, concave function of 
Jm for a fixed Pm- Hence, a Nash equilibrium is achieved by uniformly distributing the transmitter's and jammer's powers 
between the frames: 



< E 



<7^ < 1 - exp 



< 1 — exp 



1 



exp 



A(c-l) 
-A(c-l) 
-A(c-l) 



2 1 

N 



Pm 



V 



< 



< 



Jm 



V 



(82) 



This saddlepoint is an equilibrium of pure strategies, and hence also an equilibrium of mixed strategies. Note that the existence 
of such an equilibrium of pure strategies might no longer hold for different probability distributions of h, and this would demand 
a search for purely probabilistic strategies. For example, when the c.d.f. of the channel coefficient F(K) is not concave, then 
F((c — 1) '^^p^^ ) is no longer a concave function of Jm, and hence the optimal jammer strategy is not deterministic. 
Numerical evaluations of the system's performance under the present scenario are presented in the next subsection. 



A. Numerical results 

The probability of outage as a function of the transmitter's power constraint V is shown in Figure [TOl for M = 1, and under 
the assumption that both the transmitter and the jammer distribute their powers uniformly over the frames. 

For comparison, the maximin and minimax solutions of the pure strategies game and the mixed strategies Nash equilibrium, 
all under the scenario that channel state information is fed back by the receiver, are also shown in the figure. 

Note that when the receiver does not feed back the CSI, the system performance suffers degradation. Unlike in the fast 
fading scenario of [1], in the present slow fading scenario the increase in the outage probability is significant. The difference 
is most visible at low transmitter powers, when not feeding back the channel state information amounts to worse performance 
than the pessimistic (minimax) scenario with full CSI. 



VI. Conclusions 

We have studied the jamming game over slow fading channels, with the outage probability as objective. Similarly to the 
fast fading scenario, the game with full CSI and average (or long term) power constraints does not have a Nash equilibrium 
of pure strategies. Nevertheless, we derived the minimax and maximin solutions of pure strategies, which provide lower and 
upper bounds on the system performance, respectively. 

In addition, we investigated the Nash equilibrium of mixed strategies. Compared to the fast fading scenario [1], the Nash 
equilibrium for the slow fading, full CSI game is much more involved. The difference comes from the fact that frames are 
not equivalent. In fact, instead of being characterized by the channel statistics as in [1], the frames are now characterized by 
different channel realizations. This results in the existence of an additional third level of power control. 

We also showed that for parallel slow fading channels, the CSI feedback helps in the battle against jamming, since if the 
receiver does not feed back the channel state information, the system's performance suffers a significant degradation. We expect 
this degradation to decrease as the number of parallel channels M increases, until it becomes marginal for M ^ oo (which 
can be considered as the case in [1]). 

These results, along with our conclusions from the first part of this paper [1], reveal an interesting duality between the ways 
that different communication models behave with and without jamming. As remarked in [1], under a fast fading channel with 
jamming, the feedback of channel state information brings little benefits in terms of the overall probability of outage. The 
same tendency is observed for the fast fading channel without jamming in [14] (although the performance measure therein is 
the ergodic capacity). However, [10] shows that for a parallel slow fading channel, the CSI feedback is quite important. The 
improvement of the probability of outage when the channel coefficients are perfectly known to the transmitter is no longer 
negligible. The results of our present paper demonstrate that even in the presence of a jammer (which can eavesdrop the 
feedback channel and hence obtain the same CSI as the transmitter), CSI feedback improves the transmission considerably. 



24 



P VS. P for R=2, J=10,G^=10, h distributed exponentially with parameter ?l= 1/6; receiver CSI only 




Transmitter power constraint P 



Fig. 10. Outage probability vs. transmitter power constraint V for M = 1, with and without CSI feedback when J' = 10, R = 2, af^ = 10 and h is 
distributed exponentially, with parameter A = 1/6. (Mixed strategies.) 



Appendix I 

Short-Term Power Constraints - Proofs of Main Results 

A. Proof of Proposition [7] 

The proof is an adaptation of the results in Section IV.B of [2], regarding uncorrelated jamming with CSI at the transmitter. 
The only difference is that in our case, the power constraints and cost function involve short-term, temporal averages, while 
in [2], they are expressed in terms of statistical averages. Nevertheless, the same techniques can be applied. 

The set of all pairs {P{h)^ satisfying the power constraints is convex, since the power constraints are linear functions 

of P{h) and J{h), respectively. Moreover, the cost function 

/M(h, P{h)^ J{h)) = ^ log(l + -J^) 

IVl (T AT -h dm 

m—O 

is a convex function of J{h) for fixed P{h), and a concave function of P{h) for fixed J{h). These properties imply that there 
exists at least one saddle point of the game. 

Writing the KKT conditions for both optimization problems we get [2] : 

^ X-j{h) = (83) 



and 



7^^ + J{h) + hP{h) 
hP(h) 



{a% + J{h)){a%^J{h)^hP{h)) 
where ^{h) and S{h) are the complementary slackness variables for P{h) and J{h), respectively. 



+ - 5{h) = 0, (84) 
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The three possible cases are [2]: Case 1: P{h) > 0, J{h) > 0; Case 2: P{h) > 0, J{h) = and Case 3: P{h) = J{h) = 0. 
For Case 1 both complementary slackness variables are 0, and solving ([83]) and ([84l) together we get 



A J{h) + a% 
/i " P{h) ' 

and 



(85) 



""^'^^WTwr '''' 

while for Cases 2 and 3, the solution is plain water-filling [2]. 
These considerations result in the solutions (|5]) and ©. 

B. Proof of Theorem \T} 

This proof follows the one described in the Appendix B of [10]. The probability of outage can be written as: 

Pr(/M(h, P{h), J{h)) <R)= ^[X{/M(h,P(/.),j(/z))<i?}], (87) 

where X{^} denotes the indicator function of the set Replacing the power allocations by the solutions of the game described 
by © and dU, we define 

X*(h) = X{iMih,p*{h),j*ih))<R}' (88) 

Then the region U{R^V ^ J) can be written as: 

U{R,V,J) = {h G Mf : x*(h) = 0}. (89) 

We next use the fact that the pair {P*{h)^ J*{h)) determines an equilibrium of the game ©, dU. Thus, for any random 
power allocation P{h) satisfying the power constraint, we can write: 

X*(h) < X{/M(h,P(/i),j*(/i))<i?}, with probability 1. (90) 

Similarly, for any random J(/i), we have 

X*(h) > X{/M(h,p*(/i),j(/i))<P}, with probability 1. (91) 

Now pick some arbitrary power allocation functions Pa{h) and Ja{h), which satisfy the short-term power constraints, and 
set 

P{h) = (1 - x*(h))P*(/i) + X*(h)Pa(M, (92) 

and 



J{h) = (1 - X*(h)) Ja(/^) + X*(h) J*(/i), (93) 

easy to see that P{hm) 

that 



It is easy to see that l/MX]m=o^ P{hm) ^ with probability 1 , ^/MY^^^q J{hm) < J with probability 1, and moreover 



X*(h) =X{ 

Note that transmitter and jammer could pick Pa{h) = and Ja{h) = respectively, but this strategy would not improve 
their performances (power cannot be saved), since the only power constraints are set over frames. 
Now, using ([87]), ([90]) and ([91]), we get: 

Pr{lM{h,P{h),J{h))<R) > 
>Pr{lM{h,P{h),J{h))<R) > 
>Pr{lM{h,P{h),J{h))<R), (95) 
which proves the existence of a Nash equilibrium of the original game. 
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Appendix II 

Long-Term Power Constraints: Pure Strategies 



A. Proof of Proposition \2\ 

Take Problem 1. Let {^\T) = ((^o . A% • • • , ^m-i). (^o% ^1% • • • , ^m-i)) be a solution such that YZzI = ^m,i 
Xlm=o^ "^m = -^M,i, and assume that /m(^*,3*) > R- Since /m is a continuous, strictly increasing function of Pq, 
without loss of generality, we can find Pq < ^o* such that /m((Po, Pf , • • • , Pm-i),5*) = R- 



But then Pq 



Y^m^i Pm < MPm,i, which means that is suboptimal (from the transmitter's point of view), and 



hence not a solution. 

Therefore, the first constraint Im ^ R has to be satisfied with equality, i.e. Im = R- 

Now take the solution (^*, 3*), and assume that jj Em=o JL<Jm- Then we can find J'q > Jq*, such that Jo+Em=i = 
MJm- In order for the first constraint Im = R^o be satisfied, the value and distribution of Pm will have to be modified. 

We prove next that the value of Pm should be increased, which makes the pair suboptimal (from the jammer's 

point of view), thus contradicting the hypothesis that it is a solution, and proving that the second constraint should hold with 
equality. 

Assume there is a distribution = (Pq^, P{', . . . , Pm_i) that minimizes Pm, under the constraint /M({Pm}, (-^o, Ji , . • . , Jm_ 
R, such that 



M-l 



Pi <P, 



MA- 



(96) 



m=0 



Then, replacing Jo by its old value Jq, we have that is either a second solution of Problem 1 (if (1961) is satisfied 

with equality), or a better choice (if ([96l) is satisfied with strict inequality). We can readily dismiss the latter case. For the 



former case, Im is a strictly decreasing function of Jo, thus /M(^^'^3*) > R, which contradicts the first part of this proof. 
The same arguments work for Problem 2. 



B. Proof of Proposition \3\ 

Proposition [3] is a direct consequence of Theorem 8 in the Appendix II.D of [1]. We restate the theorem here for completeness. 
For a complete proof, see the first part of this paper [1]. 

Theorem 6: Take x^y e P^[M] and define the order relation x > y if and only if x{t) > y{t) \/t G M. Consider the 
continuous real functions /(x), g{y) and h{x^y) over P^[]R], such that / is a strictly increasing function of x, ^ is a strictly 
increasing function of y, and is a strictly increasing function of x for fixed y and a strictly decreasing function of y for fixed 

X. 

Define the following minimax and maximin problems: 



max 

y>0 



mmf{x) s.t. hix^y) > H 

x>0 



s.t.g{y) < G, 



(97) 



max 

x>0 



min g{y) s.t. h{x,y) < H 

2/>0 



s.t./(x) < F, 



(98) 



mm 

y>0 



max/i(x,^) s.t. f{x) < F 



x>0 



s.tg{y) < G. 



(99) 



(I) Choose any real values for G and H. Take problem (l97l ) under these constraints and let the pair {xi^yi) denote one of its 
optimal solutions, yielding a value of the objective function f{xi) = Pi. If we set the value of the corresponding constraints 
in problems (l98l ) and (l99l ) to P = Pi, then the values of the objective functions of problems ([98l) and ([99l) under their optimal 
solutions are g{y) = G and h{x^y) = H, respectively. Moreover, (xi^yi) is also an optimal solution of all problems. 

(II) Choose any real values for P and H. Take problem (l98l ) under these constraints and let the pair (x2, ^2) denote one of 
its optimal solutions, yielding a value of the objective function ^(^2) = G2. If we set the value of the corresponding constraints 
in problems (l97b and (l99b to G = G2, then the values of the objective functions of problems (l97b and (l99l ) under their optimal 
solutions are f{x) = P and h{x^y) = P, respectively. Moreover, (^2,^2) is an optimal solution of all problems. 

(III) Choose any real values for P and G. Take problem (l99l) under these constraints and let the pair (xs, ys) denote one 
of its optimal solutions, yielding a value of the objective function h{x^^y^) = Hs. If we set the value of the corresponding 
constraints in problems (1971) and (l98l) to H = Hs, then the values of the objective functions of problems (l97l) and (l98l) under 
their optimal solutions are f{x) = P and g{y) = G, respectively. Moreover, (^3, ys) is an optimal solution of all problems. 
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C Proof of Proposition H] 

Take Problem 1. By Proposition [S] if there exists Pm,i such that solving the game in ([3]) and Q with the constraint 
Y^^Zi Pm < MPm,i yields the objective ImO^^ {Pm}^ {Jm}) = then the solution of Problem 1 coincides with the 
solution of the game in ([3]) and 

We write this solution as in ([5]) and ©, but we denote A = l/r^ and fi = v/t]: 



(A-^)+ 

Xh 



if /^m < 

if hm, > 



(100) 



7* 



if /^m < 

if hm. > 



(101) 



where A and /i are constants that can be determined from the constraints Ylm=i '^rn = MJm and Ylm^i H^m^ Pm^ Jm) = 
MR. 

We shall use the following conventions and denotations: 

• Without loss of generality, we shall assume that the blocks in a frame are indexed in increasing order of their channel 
coefficients. That i^, < hi < . . . Jim-i- 

. Denote Xm = Jm ^ ct% and = J;; + cr%. Note that § > |^ > • • • , > 

• Denote by hp the first block on which the transmitter's power is strictly positive, and by hj the first block on which the 
jammer's power is strictly positive. Note that hp < hj. 

Note that 



rim. 



(102) 



for all m G {0, 1, . . . , M — 1}, where = maxjz, 0}. 
Given these and (llOOt and (llOlt above, we can write: 



^<A< 



cr^ T < A < cr^ 



,2 1 + 



(103) 
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Mi? = ^ log 
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M-1 



Xhr^ 



y log ( 



^hm) ' 
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Denote by Qu\fA denotes the index of the smallest channel coefficient in the frame that is larger than h. With this notation, 
we can write 



P>Qu 



hp-i < 



hj-i 



1 + i^hj-i 
1 + jj.hj 



(106) 
(107) 
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y log ( — L- 



(109) 



where ( 11081 ) follows from Jm = J2' 



M-l 



P< 



l-\-fihj 



and the first inequafity in (llQ9b follows since < implies 

because there is no other channel coefficient between hp-i and hp. 
It is straightforward to show that for fixed hj the left-most and the right-most terms of inequality (I1Q8I) are strictly decreasing 
functions of /i, while the left-most and the right-most terms of inequality (1 1091) are strictly increasing functions of /i. 
Note that 
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and 



m—Qu 
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[l+^lhj J 



1 + liihj 



M-l 



M-l 
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log 
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(111) 



That is, by keeping /i constant and replacing hj by in both first terms of jlOSt and (11091) , we get exactly the last terms 
of (11081) and (11091) , respectively. 

Finally, we take a contradictory approach. Suppose there exist two different pairs (/iji,/ii) and (/ij2,M2) that satisfy both 
(1108b and (11091) and assume, without loss of generality that hji < hj2. Then, in order for (/ij2,M2) to satisfy (11081) we need 
/i2 > Ml, while in order for (/ij2, M2) to satisfy (11091) we need /i</ii. Thus /ij is unique. Note however that the relations above 
do not guarantee the uniqueness of /i. 



For the optimal hj, the constraint Ylm^i ^ MJm translates to 



M-l 



Xhr, 



lihn 



= MJm + (M ■ 



(112) 



while the constraint /M(h, {Pm}, {-^m}) = ^ is already given in (11051) . The left hand side of (1112b is a strictly increasing 
function of A for fixed /i and a strictly decreasing function of /i for fixed A, while being equal to a constant. 

Again, for a contradictory approach, suppose there exist two different pairs of (/ii,Ai) and {112^^2) that can generate 



different solutions. If we assume, without loss of generality that jii > /i2, then, in order for (1112b to be satisfied by both 
pairs, we need Ai > A2. But this can only mean that under (/i2, A2) the transmitter allocates non-zero power to more channel 
coefficients than under (/ii,Ai). This remark simply says that the index p at which the transmitter starts transmitting is a 
decreasing function of A, and can easily be verified by (1102b . 

Looking now at (1105b , we observe that its right hand side is a strictly increasing function of A for fixed fi and a strictly 
increasing function of /i for fixed A, while being equal to a constant. In other words, if (1105b is satisfied by the pair (/ii, Ai), 
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then it cannot also be satisfied by (/i2, A2). Thus, the pair (A, /i) that satisfies both (llQ5t and (1112b is also unique. But once 
hj, A and /i are given, is uniquely determined. Therefore there cannot exist more than one solution to Probleml. 
Similar arguments can be applied to show that the solution of Probleml is unique. 



D. Proof of Proposition \5\ 

Since the solution is unique, it follows that 3^m{Jm) is a strictly increasing function. By closely inspecting the form of 
the solution in (II 001) and (IIOIK it is straightforward to see that if Jm 00, then ^ 00 for all m G {0, 1, . . . , M — 1}. If 
the required Pm were finite, this would imply Im 0, which violates the power constraints of Problem 1. 

For Problem 1 we prove that the resulting S^m{Jm) function is continuous and concave in several steps. We first show in 
Lemma [T] that the optimal jammer strategy {x"^}^!^ is a continuous function of the given jamming power Jm- Lemma [2] 
proves that PM({^m}) is continuous and has continuous first order derivatives. This implies that Pm{Jm) is in fact continuous 
and has a continuous first order derivative. Finally, Lemma [3] shows that for any fixed hp and hj the function Pm{Jm) is 
concave. 

Lemma 1: The optimal jammer power allocation {x%^}^Zq within a frame is a continuous increasing function of the given 
jamming power Jm invested over that frame. 

Proof: It is clear that x"^ is continuous and increasing as a function of Jm if hp and hj are fixed. At any point where 
either hp or hj change as a result of a change in Jm, the optimal jamming strategy {x^}^~q maintains continuity as a result 
of the uniqueness of the solution (Proposition [4]). ■ 

Lemma 2: Both PM{{xm}) and the derivatives are continuous functions of {xm)m^Q- 

Proof: 

Consider any two points Xi = (^i,m)^^o = {x2^ni)^=l trajectory T that connects them. 

For a given vector X = {xm)^ZQ^ the required transmitter power is 



M 




(113) 



Note that p depends upon the choice of X. For fixed p, the continuity and differentiability of Pm{^) are obvious. Thus, it 
suffices to show that these properties also hold in a point of % where p changes. 

If we can show continuity and differentiability when p is decreased by 1, then larger variations of p can be treated as 
multiple changes by 1, and continuity still holds. 

Recall the assumption that the channel coefficients are always indexed in decreasing order of the quantities jf^. Let Xk = 
{xk,m)m=o ^ point of T where the transmitter decreases the index of the block over which it starts to transmit from pk to 
Pk — I, and denote by Ti the part of the trajectory T that is between Xi and X/c, and = T \ Ti. 



Since P, 



0, we know that A does not change in this point, since 
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Define the "left" and "right" limits PM{Xk — ) and Pm(X/c+) as: 



PMi^k-) lim Pm(X), 



(114) 
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PM(Xfc+) = lim Pm(X). 

xe^x^ 

Since is Hausdorff [15], there exists a small enough neighborhood il C ] 



(116) 



of X/e, such that p{X) = pk to the "left" and 
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p{X) = pk — I to the "right" of Xk on il. We can now write: 



M -pk + 1 _ J_ Xk^ 

M ^ hrr 



= A 
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M-pk 
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(117) 



where the last equahty follows because A = ^ . This proves continuity. 



Pk-\ 



Similar arguments can be used to show the continuity of the derivatives 



dPM 



dXn M \Xn hn 
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(118) 



in Xk (note that 



Xk,pf^ — 1 



Therefore, Pm{X) is continuous and has first-order derivatives that are continuous along any trajectory T between any two 
points Xi and X2. ■ 

Finally, for the last part of our proof: 

Lemma 3: For fixed p and j, the function Pm{Jm) is concave. 
Proof: 



We can write 



MJm + (M - j)a% 
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and denote 
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Note that for fixed p and j, Jm is a linear function of ^. 

A similar relation can be found for the required transmitter power Pm ' 
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(121) 



Denote 



M-l 



/(m) = n 



1 



1 + /i/l 

M-l 



(122) 



and note that for fixed p and j, Pm is a linear function of /. 

It suffices to show that f{g) is concave. For this purpose, the derivative ^ = ^(^)~^ should be a decreasing function of 
g, and hence an increasing function of /i. 
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Computing the derivatives from (1119b and (1121b we get: 
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j l-\-flhrr 
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EM-1 hm 
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1 ^M-1 
i—p 2-^m=j 



^2 



(123) 
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Arguments similar to those in [1] apply in proving that above the derivative increases with /i. Looking at the right hand 
side of (I123t (the "large fraction"), we notice that the first term in the numerator increases with /i. For the second term 
in the numerator, it is clear that as /i increases, its numerator decreases faster than its denominator. This implies that the 
whole numerator of the "large fraction" is an increasing function of /i. Similarly, the first term in the denominator is clearly 
a decreasing function of fi. The only thing left is the second term of the denominator. It is straightforward to show that its 
derivative with respect to fi can be written as 
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If we consider the fact that for any two real numbers a and h we have 

(a^ + h^f - (a + h){a^ + h^) = -ah{a ■ 



(124) 



(125) 



and the summations in (1124b are positive, it is easy to see that the second term of the denominator of the "large fraction" is 



decreasing with ji. Hence overall the derivative in (1123b increases with ji. 



Appendix III 

Long Term Power Constraints: Mixed Strategies 

A. Proof of Theorem |?] 

Denote the solution of the game in (O and (|4]), where the jammer is constrained to j^Y^^Zi Jm ^ Jm{pm) and 
the transmitter is constrained to j^Y^^Zi Pm ^ Pm by {{Pm,i}i {Jrn,i})^ and the solution of the game in ([3]) and d?]), 
where the transmitter is constrained to Em=i -^rn ^ PmUm) and the jammer is constrained to Em=i — 

{{Pm,2}^ {Jm,2})- 

Denote the solution of the game in (|3]) and dU, where the jammer is constrained to Em=i — and the transmitter 
is constrained to ^ Em=i ^rn < Pm by ({Pm,o}, {^m,o}).. 

By the Proposition [2 we must have /M({^m,i}, {Jm,i}) = R and /M({^m,2}, {Jma)) = where lM{{Pm}, {Jm}) = 

We will show that (i) even if the jammer's power Jm is different from Jm{pm), the transmitter's strategy is still optimal; 
(ii) even if the transmitter's power pm is different from PmUm), the jammer's strategy is still optimal. 
Assume the transmitter plays the strategy given by {Pm,i}- 

If Jm = Jm{pm), it is clear that the optimal solution for both transmitter and jammer is the solution of the game in ^ 
and (O, where the jammer is constrained to Y^m^i — transmitter is constrained to Ylm=i — Pm- 

In this case, it is as if each player knows the other player's power constraint. 

If Jm < Jm{pm), then by Lemma[T]we have that Jm,o < Jm,i Vm. Since lM{{Pm}^ {Jm}) is a strictly decreasing function 
of {Jm} (under the order relation defined in the Appendix III of [1]), this implies that /M({^m,i}, {Jm,i}) > R- Note that 
{Jm.o} is the jammer's strategy when the jammer knows the transmitter's power constraint pm- Thus we have shown that 
when the transmitter plays {Pm,i} and jm < Jm{pm), the jammer cannot induce outage over the frame even if it knew the 
value of Pm- 

Assume that the jammer plays the strategy given by { J^^2}- A similar argument shows that if pm < PmUm), or equivalently 
Jm > Jm{pm), the transmitter cannot achieve reliable communication over the frame even if it knew the exact value of Jm- 
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This shows that ({Pm,i}, {-^m,2}) is a Bayes equiHbrium [12] for the game with incomplete information describing the 
power allocation within a frame. 

B. Proof of Proposition |9l 

Take any solution {Pm(/?^)*}, {-^m(^)*} of the KKT conditions and denote by P*^^ the outage probability obtained under 
these strategies. By maintaining {Jm(^)*} constant and changing {Pm(^)*}, the resulting probability of outage can only be 
greater than or equal to P*^^, since the original {Pm(/^^)*} is the solution of a minimization problem with convex cost function 
and linear constraints. 

Similarly, by maintaining {PM{hY} constant and changing {Jm(^)*}, the resulting probability of outage can only be less 
than or equal to P*^^, since the original {Jm(^)*} is the solution of a maximization problem with concave cost function and 
linear constraints. 

These arguments imply that {Pm(/?^)*}, {-^m(^)*} is a Nash equilibrium of the game. 
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